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Abstract 

In this paper we introduce a certain space of higher order modular 
forms of weight and show that it has a Hodge structure coming from 
the geometry of the fundamental group of a modular curve. This gen- 
eralises the usual structure on classical weight 2 forms coming from the 
cohomology of the modular curve. Further we construct some higher order 
Poincare series to get higher order higher weight forms and using them 
we define a space of higher weight, higher order forms which has a mixed 
Hodge structure as well. 
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In the theory of automorphic forms, the classical holomorphic modular forms 
and their complex conjugates play a special role - they are the forms most closely 
linked to geometry. Spaces of such modular forms can be identified with the 
cohomology groups of certain locally constant sheaves on modular curves. From 
this point of view certain things, like Hecke operators, become very natural and 
this is the first step in associating a motive to a modular form. 

Second order modular forms were introduced by Goldfeld and have been 
studied in some detail by several people. Examples of such forms we also dis- 
covered in a different context by Kleban and Zagier [KZ03j . In |CDO02j . the 
notion of a higher order automorphic form was considered and the spaces of 
such forms were studied. One can speculate as to whether there is any geome- 
try underlying these spaces of automorphic forms. In general, these spaces can 



be rather large and one cannot expect much. However, in this paper we consider 
certain subspaces with additional structure that can be understood as the gen- 
eralization of the space of classical holomorphic modular forms. We show that 
these spaces can be identified with certain spaces coming from the fundamental 
groups of modular curves. 

In weight 0, the spaces we consider are the spaces of anti-derivatives of 
iterated integrals of smooth 1-forms. In the classical situation the Eichler- 
Shimura isomorphism identifies the spaces of holomorphic modular forms along 
with the conjugates of cusp forms with the cohomology groups of locally constant 
sheaves on a modular curve and these spaces have mixed Hodge structures. We 
show that our spaces can be identified with graded quotients of the dual of 
the group ring of the fundamental group of the modular curve generalizing the 
Eichler-Shimura theorem. These quotients have mixed Hodge structures due to 
Hain |Hai87j and Morgan. Using this, we can define a mixed Hodge structure 
on the space of weight higher order forms. In general, this Hodge structure 
depends on the base point. Deligne and Goncharov DG05] show that this Hodge 
structure is the same as that on a cohomology group of a pair. 

For higher weights, we generalize a construction of Goldfeld and O 'Sullivan 
[GO03] using twisted Poincare series to construct some higher order higher 
weight forms. We show that, when the weight k > 2, these spaces of such forms 
also have a mixed Hodge structure. 

One purpose of relating the higher order forms to the geometry of the modu- 
lar curve is to define a Hecke theory. Classically the Hecke operators are the op- 
erators induced on the cohomology groups by certain algebraic correspondences. 
In the higher order case, however, one cannot use this as Hecke correspondences 
do not induce maps between homotopy groups or on the corresponding Hodge 
structures. This perhaps explains why there is no satisfactory Hecke theory for 
higher order forms. 

In weight 0, much of the theory is analogous to the theory of Multiple Zeta 
values and the geometry of P 1 — {0, 1, oo} due to Deligne, Goncharov [DG05J 
and others. From this point of view the higher order modular forms can be 
viewed as generalizations of the single variable multiple poly logarithms. 
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1 Higher order automorphic forms 

Let T be a discrete subgroup of SX 2 (1R) with no elliptic fixed points, so T is 
isomorphic to the fundamental group of X = T\$j, wi(X, x ) at some point 
x E X. Let Z[r] be the group ring and J = J XQ =< 7 — 1 > the augmentation 
ideal of Z[T] which fits in the exact sequence. 

J -> Z[T] ^ g Z -> 

If / : $j — > C is a function and fceZ define 

(f\k7)(z)=j(l,z)- k f( 7 z) 

where 7 = ^° is in SL2 (R) and z) = (cz + d) is the usual automorphy 
factor. We extend this to an action of Z[r] on the space of functions by defining 

An automorphic form of weight k for T is a function such that 

/Ut = 

for all 7 in J. More generally, for s £ N, we define a higher order automorphic 
form of weight k and order s for T to be a function / : ij — > C such that 

/Ife7 = 

for all 7 in J s . Let Af| = M|(r) denote the space of higher order automorphic 
forms of order s. We further define M®(T) to be the constants C. For s = 1 with 
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the added conditions of holomorphy and growth at the cusps, gives the classical 
modular forms of weight k. For a fixed weight k there is a natural filtration by 
order 



These spaces can be rather large, so one cannot expect much structure. In this 
paper we study a certain subspaces of the space of these forms which have a lot 
more structure. 

2 Iterated Integrals 

Let X be a smooth manifold with a point xo- Let P(X) = P(X, x ) denote the 
space of loops on X based at x , namely, continuous functions 



A function <j> : P{X) — ► R, where R is a ring, is said to be a homotopy functional 
if (f> depends only on the homotopy class of 7. That is, it defines a function on 
F = tti(X, xo) or equivalently an element of Hom J 4(,G rps (Z[r], R) 

Let E'(X) denote the de Rham complex of smooth forms on X. It is a 
differential graded algebra (dga) - where a differential graded algebra is a graded 
algebra A with a degree 1 map d : A — ► A such that 

• do d = 

• d(a ■ b) = d(a) ■ b + (-l) d °s( a )a • d(b) 

Let w be a 1-form in A 1 (X), where A*(X) is a sub dga of E*{X). The map 



where 7*(o>) = f(t)dt, defines a function on P{X). This defines an element of 
Hom(Z[r],R) if and only if ui is closed. Hence this only detects elements of F 
visible in the homology of X. It vanishes on J 2 as if (a — !)(/? — 1) £ J 2 , then 



Ml C Ml CM?... M" C M s k +1 . . . 

ru A. fv /v ft, 



7:[0,l]-X, 7 (0) = 7(l)=a:o. 





w 
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so 

Ul — / Ul — I Ul + I L) = 0. 



Ia0 

The iterated integrals studied by Chen [Che7l] detect more elements of the 
group ring. Suppose oj\, ui 2 , u> r are smooth 1-forms in A (X) and 7 is a path 
on X. Define 



Wi£J 2 — Wr =/••■/ fl(ti)f2{t2)—fr(t r )dtidt 2 — dt r (1) 

J J 0<tl<t 2 ...<tr<l 

where J*(u>i) = fi(t)dt. This defines a function on the space of paths of X which 
will be denoted by J U!i...u> r and is called an iterated line integral of length r. A 
linear combination of such functions is called an iterated integral and its length 
is the length of the longest line integral. Length iterated integrals are defined 
to be constant functions. Let B S (A*(X)) denote the space of iterated integrals 
of length < s coming from forms in A' . 

An iterated integral is not necessarily invariant under homotopy. Chen [Che71| 
formulated a condition in terms of differential graded algebras under which it- 
erated integrals which are homotopy functionals are closed with respect to a 
certain differential. However, we have no use for that formalism in what follows 
so we will not describe it. It does underlie the following notation though. Let 
H°(B S (A*(X)), xq) be the space of iterated integrals of length < s which are 
homotopy functionals on loops based at a point xq on X modulo those iterated 
integrals which integrate to along any path. We shorten this to H°(B S (X), Xo) 
if A'(X) is E'(X). 

If I is in B S (A'{X)) and 7 in T. Let 



<I,7>= / / 

denote the evaluation map. This can be extended by linearity to all of Z[L]. 
Let H°(B s (A'(X),x ) denote the subspace of H°(B s (A'(X)),x ) such that 

< /, T] X0 >= 

where rj Xo denotes the constant loop at x$. Namely, these are iterated integrals 
with constant term being 0. 

We have the following propositions that can be found in |Hai87j . As we will 
have to appeal to them several times we find it useful to repeat them here. 
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Proposition 2.1 (Hain[Hai87], Proposition 2.9). Let j u>i ...u> s be an iterated 
line integral and a and (3 two paths such that a(l) — /3(0). Then 

Ul . . . 0J S = ^ / U3\...U3i I UJ i+ i ...U3 a 

where an empty integral is to be understood as 1. 

As a corollary one has, 
Corollary 2.2. //a,: are loops and /3(0) = cy.i{l), then 

I U3\ . . . U) s = ^ / Wi . . .OJi / UJ l+ i . . . UJ S 



Let 

p s :H°(B s {X),x ) — f 0fl- x (Jr,C) 

be denned as follows. For «i ® • • • <8> a s G ®Hi(X, C), where a, are loops based 
at xo, 

p s (/)(® 4 s =ia l ) = (/,n(^- 1 ) 

Proposition 2.3 (Hain[Hai87], Prop 2.10, Prop 2.13). If u>i .. .u> r are smooth 
one-forms on X and a±, . . .a s are loops based at xq then 



Finally we state another proposition which allows us to reduce the length of 
an iterated integral if one of the terms is exact. 

Proposition 2.4 (Hain Hai87], Prop 1.3). Suppose u>i, ...u> s are 1- forms on X 
and 7 is a path on X . If f is a function on M then 



dfui ...u s = / (fuJi)uJ2 ...ijj s - /(t(0)) / wi...w s 



G 



(jJi...Ui-idfui...uj 3 = / ui . 

J j 



(fu>i)uJi +1 ...IV. 



LUX... 



's 
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/ wi . . .u s df = /(7(1)) / wi...u; s - / wi . . . w s _i(/w s ) 
J ~y J ~f J y 

This shows there exist non-trivial iterated integrals which integrate to 
along any path. 



3 Higher order modular forms of Geometric ori- 
gin 



Now let X = T\Sj where L is an arithmetic subgroup of and let it : 

ft — > X be the canonical map. Let x be a point on X. We further assume 
that r has no elliptic fixed points, so T ~ tti(X, xq). In this section we define a 
subspace of the space of higher order automorphic forms of weight for T which 
has an additional structure coming from the geometry of the curve X. As X 
is a curve, it has the cuspidal compactification X = T\(Sj U P 1 (Q)), which is a 
smooth projective curve. We also define a subspace of this space coming from 
X which generalize the classical cusp forms. Let D = T\P 1 (Q) be the set of 
cusps - X = X U D. 

We have the following theorem 

Theorem 3.1. Let I be an iterated integral on X of length < s which is a 
homotopy functional. Let xq denote a point on X. Let Zq denote a point of 9) 
lying in the fibre over xq ■ Then the function Fj on Sj defined by 



is a higher order modular form of order s + 1 . Here and from now on by abuse 
of notation we use L to denote both the integral on X as well as its pullback 
7r*(J) on ft. As before we define an empty integral to be 1 and hence integrals 
of iterated integrals of length 0, namely constants, are just constants. 
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Further, this gives a well defined injective linear map 
H°(B s (X),x ) M 5+1 (r) 



Proof. Let J be homotopy functional of length < s. This has an expression of 
the form 

|J|<8 

where cjj = Wj-j . . -0Jj rj are iterated line integrals. We need to show that for 
any 71,72, ■ ■ .,7«+i £ I\ 

Let 77 be a path from zq to z on ,f). If 7 is a loop on X based at xq, then one has 
a composite path 777(77) on X from Xo to 7r(z). This can be lifted to a unique 
path on S) from zq to 72 passing through jzq. We denote it by 7?/. 
Notice that 

F I \ 11 - 1 {z) = / 1-1=1-1= I 

Jzo Jzq Jjm Jri J (71 -1)77 

as 

J I= 1 

since / is T- invariant. 

For each iterated line integral u)j = u>j 1 . . . ujj r appearing in / we can apply 
Corollary 12.21 and Proposition 12.31 to get 



/ = / ■ ■ ■ Uji / . . . uj Js 



/ rc = i(7 l -l)'; i=1 «Tl*=i(7i-l 

Therefore 



riLi J 7j w A if r=s 
if r < s. 



|J|= s i=l ,/ 7i 

and this expression is independent of z. In particular, applying 7^+1 — 1 anni- 
hilates it so Fi\ JS +i = 0. 

It should be remarked that since I is a homotopy functional, Fi{z) does 
not depend on the path from Zq to z but the iterated line integrals wj need 
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not be homotopy invariant and hence we had to choose paths. However, by 
construction, the sums of iterated line integrals that appear in the expression 
of Ff| 7l „!)(z) as a sum of products of iterated line integrals are homotopy 
functionals. That is, we can collect terms together such that 

J zo J zo "'(71 — 1)»7 r =l z ° z ° 

where I[ and are homotopy functionals. Note that If = 7° = I. 

To prove injectivity, suppose I is of order s and i*Y = 0. Then in particular, 
for any 7 in T, 

F I { 1 z Q )= / 1 = 

J z 

hence J is as a homotopy functional. Hence I = in H°(B S (X), x ). 

□ 

3.1 The space of geometric higher order modular forms 

A higher order automorphic form is said to be of geometric origin if it lies in 
the image of the map 

* :H (B s (X),x )^M° + \r) 
The space of such geometric higher order modular forms will be denoted by 

We have an inclusion map 

* : H°(B S (X), x ) — > H°(B„(X), x ). 

A geometric higher order modular form is said to be cuspidal if it lies in the 
image of 

*oi:H°(B s {X),x ) ^M s+1 (r). 

We denote the space of geometric cuspidal forms by Sg^ m (T,xo)- 

If K is in H°(B S (X), xo) then for all a in T a , where T a denotes the stabilizer 
of the cusp a, 



L 



K = a 
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where a is a constant. This is because K = I + a, where I is in H°(B(X), xq) 
and a is a constant, and 

ax 

1 = 

x 

as the loop {xq, ctxo} on X is homotopic to the constant path on X. 

A consequence of this is the following lemma, which we will have occasion 
to use later. 

Lemma 3.2. For K in H°(B s (X),xo) we have 

K - [ K = 

2 J Z 

for all parabolic a £ T a for all cusps a. In particular, for a geometric higher 
order cusp form f we have 

fU-i = o 

for all parabolic a G T a for all cusps a. 

Proof. Any K in H°(B S (X), xq) is of the form I + a, where a is a constant and 
I is in H°(B(X), xq). Hence 

az pz i*(jz pz 

K- K={a+ I) — (a+ I) 

Zq J Zq J Zq J Zq 

az 

I- I I 



From Proposition 12. II we have 



(7 Z fZ c<7Z 



s-1 



I= I+ I + 22 / T 'r / 7 " 

zo J z a Jz r _ 1 J z Jz 

Where I' r and I" are certain iterated integrals which are homotopy functionals 
but of order between 1 and s — 1. Since this calculation is happening with 
respect to forms on X, I, I' r and I" are all in H°(B S (X), n(z)). Explicitly, this 
expansion comes from a repeated application of Propostion 12.11 - so the forms 
which constitute the I' r s and I"s are the forms which constitute / and / is made 
up of forms on X. Hence all the iterated integrals are in B S (X). Since we also 
know they are homotopy invariant, they are in H°(B s (X),ir(z)). 
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Since a £ T a one has 

pcrz 

I = and / I" = 



therefore most of the terms vanish and 



1= I 



A geometric cusp form is of the form f(z) = K for some K 6 H°(B S (X), xq) 
for some s. Hence for all z, 

/U-i(*)= / K- K = 

J Z J Zq 

□ 

From the work of Chen[C he71j there is an isomorphism 

H°(B s (A'(X)),x ) — > Hom(Q[^ 1 (X, a ; )]/J s+1 ,C) 

and 

H°(B s (A'(X)),x ) — ► Hom(J/J s+1 ,C) 

where A* is any complex quasi-isomorphic to the de Rham complex E° . Hence 
we can relate these spaces of modular forms to quotients of the group ring of the 
fundamental group of X. This motivates the phrase 'geometric origin'. Special 
cases of such forms were considered in [DS06b . 

The second graded piece of H°(B s (X),xo) is isomorphic to the first coho- 
mology group of the modular curve X - 

Hom(J/J 2 ,C) ~ H\X,C) 

and this corresponds to the fact that the space of classical modular forms of 
weight 2 is isomorphic to the space of second order modular forms of weight 
via the map / — > F{z) = f f(t)dt. Similarly the classical cusp forms of weight 
2 correspond to cusp forms weight and exact order 2 via the same map - 
though in that case J is augmentation ideal of 7Ti(X, xq). 

More generally one can consider the completion of the group ring with re- 
spect to the augmentation ideal 

Q[ir(X,x Q )] - \imQ[7r(X,x Q )]/J s . 
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This is called the Malcev completion of the group ring. The space of all modular 
forms of weight and geometric origin can be interpreted as the dual of this 
space. 

3.2 Hodge Structures 

Hain ( and independently, Morgan ) showed that the quotients of the group 
ring with respect to powers of the augmentation ideal J have a mixed Hodge 
structure. 

Proposition 3.3 (Hain and Morgan). \Hai87j If X is an algebraic variety over 
C and Xo is a point on X , there is a mixed Hodge structure on the space 

H°(B s (X),x ) = Eom(Q[T 1 (X,xo)]/J a+l ,C) 

which is natural with respect to morphisms of pointed varieties. Further, if X 
is smooth and projective the length and weight filtrations coincide. 

In particular, this holds for the algebraic curves X = T\S) and their com- 
pactifications X. Hence the spaces of geometric higher order modular forms 
^Gelm o(^' x o) an d cusp forms So^l m Q (T,xo) also inherit mixed Hodge struc- 
tures. 

A rough outline of how the the Hodge structure is obtained is as follows, at 
least when X is a smooth curve as in our case. Essentially the same procedure 
works for a smooth quasi-projective variety. We follow Hain Hai87 . Let X 
denote its smooth compactification as above and D = X — X. Let E* (X log D) 
denote the log-complex of smooth forms with log singularities. This complex is 
quasi- isomorphic to the de Rham complex Eg(X), hence the result of Chen's 
|Che71| implies that all homotopy functionals can be obtained by iterated in- 
tegrals of such forms. So it suffices to use such forms to define the Hodge 
structure. 

One first defines the Hodge structure on the log-complex as follows 

F P E'{X log D) = { forms with > p dz's} 

dz' 

WiE'(X log D) = { forms with < I — s} 



12 



and Deligne |Del71j showed that this induces a Hodge structure on the coho- 
mology of X by defining the Hodge and weight nitrations to be the image of 
the cohomology of these nitrations in the cohomology of X. 
Define the nitrations on B S (E'(X log D)) as follows 

F P B S (E'(X log £>)) = Span of w x . . . lu t \ to, G F p * and > pj 

W t B s (E'(X log D) = Span of j^J uj x . . . u r \ u>i € W k and r + Y^h < ' j 

The Hodge and weight filtrations on B S {E*(X logD)) induce nitrations on 
H°(B S (E'(X log D))) and these define a mixed Hodge structure. Using the 
map \& we get an mixed Hodge structure on the space of geometric higher order 
modular forms of weight 0. 

If X — X is a smooth projective curve then the weig ht filtration on E l (X) 
is given by 

= W-x Cfo = E\X) 

hence 

' Bi{E'(X)) in < s. 



B S (E'(X)) if I > s. 



WiB a (E*(X)) 
Hence one has 

GrY'H°(B s (E'(X),x Q ) - H°(B s (E'(X)),x )/H (B^ 1 (E'(X)),x ) 

so the filtration by length coincides with the weight filtration and the length 
graded pieces have a pure Hodge structure. Hence the space of geometric cusp 
forms of exact order s has a pure Hodge structure. 

In general that is not true, as for example, if X is not compact and has more 
than one cusp, 

H°(B 1 (X), xo)/H°(B (X),x a ) ~ H\X, C) 

does not have a pure Hodge structure as the integral of an Eisenstein series lies 
in the weight 2 graded part of the weight filtration. So one sees that the space 
of higher order modular forms of weight and order exactly 2 does not have a 
pure Hodge structure. 
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The Hodge structure generalizes the classical Eichler-Shimura Hodge struc- 
ture on the space of classical modular forms of weight 2 as that can be identified 
with H°(Bi(X),xq). In this case the Hodge structure does not depend on the 
choice of xq, but in general it does. 

Remark 3.4. More generally one can construct the motive underlying this 
Hodge structure as the motive underlying the Hodge structure on the fundamen- 
tal group is understood. This is described in the paper of Deligne and Goncharov 
IDG05f Section 3, ( Proposition 3.4 ). 

There they show that the the Hodge structure on the graded pieces of the 
group ring of the fundamental group can be realized as the Hodge structure on 
the relative cohomology groups of pairs (X s , U|_ Xj), where 

• X s = X x • • • x X s-times 

• Xq is the sub-variety given by t% = xq - namely xq x X s-1 

• Xi is the sub-variety given by ti — U + i for < i < s - namely X* x 
A x X s ~( ,+1 \ where A is the diagonal in X x X in the i th and (i + l) st 
places. 

• X s is given by t s = xq - namely X s-1 x xq. 
We have 

H s (X s /u!= Xi,C) ^Hom(J/J s+1 ,C) = H°(B s (X),x ) 

so precisely we get the space of weight geometric modular forms of order s 
modulo those of order 0. For example, when s — 1 we have 

H x {X/{x },C) ^H\X,C) ~Hom(J/J 2 ,C). 

Hence the motive underlying the Hodge structure on the space of geometric 
higher order modular forms of weight and order s and base point xq is the 
motive associated to the pair (X s , Uf =0 Xi). Namely, to this object one can as- 
sociate a de Rham, etale and Betti realization which are isomorphic when the 
field of coefficients is large enough. 
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Remark 3.5. Classically one way of understanding Heche operators is as fol- 
lows. The space of classical modular forms of weight k along with the complex 
conjugates of the cusp forms is, via the Eichler Shimura map, identified with 
the cohomology of a local system on the modular curve, and this imposes a 
Hodge structure on this space. Heche operators can then be understood as the 
morphisms of this Hodge structure induced by certain algebraic correspondences 
called Heche correspondences. 

One might hope that the same algebraic correspondences would induce mor- 
phisms on the Hodge structure of the space of geometric higher order modular 
forms of weight thus suggesting a way to define Heche operators on these forms. 
However, unfortunately they do not, as, for example, they do not preserve base 
points and the Hodge structure does depend on the base point for s > 2. Hence 
one cannot get notions of Heche eigenf unctions or Heche eigenspaces using Heche 
correspondences and, as things stand, one cannot use this approach to define a 
motive of a higher order modular form. 

3.2.1 Product structure 

Let 

Mg eom,0 

s 

This space has a product structure induced by the product structure of iterated 
integrals 

B Sl {X)®B S2 {X) -^B S1+S2 ^(X) 

Explicitly, this is given by the shuffle product [Hai87] Lemma 2.11. 

For example, for two closed 1-forms u>i and ui2 with F Ui (z) = we have 

4 Higher Weights 

We now consider the problem of constructing higher weight higher order forms. 
Let X and xo be as above. We have the following inductive definition for 
cuspidal higher order forms. A higher order form / is said to be cuspidal if 
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• /| 7 -i is cuspidal 

• /l^-i = for all parabolic elements <fi of T, that is 

4> e Ker{-!ri(X, x ) — > wi(X, x )}. 

• / satisfies a cuspidal growth condition - for all cusps a one has 

/|fc(c r a)( 2: ) ^ e~ cy as y — > oo uniformly in x for some constant c > 
where tx a be an element of SL2 (Z) such that 



A standard way of constructing classical modular forms is by Poincare series. 
They arc defined as follows. Let a be a cusp, and c a as above so the stabilizer 
of a is r a = agToaO-^ 1 . Let m > be an integer. For k > 2, the Poincare series 
Pm,a.(z) = P m ,a.k( z ) of weight k is defined as follows 



where e{z) = cxp(27riz). This is a cusp form. We can also define this when 
m = where this then gives the Eisenstein series of weight k corresponding to 
the cusp a. The Poincare series and Eisenstein series span the space of modular 
forms for T as one varies m and the cusps and in fact, for a fixed cusp, one can 
get a basis for the cusp forms by varying m Sar90j. 

We have the following generalization of Poincare series, called twisted Poincare 
series, which give rise to higher order forms. For order 2 this is due to Goldfeld 
[Gol99 and O 'Sullivan [GO03]. In what follows we suppress the weight k in the 
notation. 

Proposition 4.1. Let k > 2 be an even integer and let I be an element of 
H°(B s (X),xo) and zq a point on S) lying in the fibre over Xq. Then, for every 
cusp a and non-negative integer m we get three twisted Poincare series. All of 
these are weight k, order s + 1 modular forms and when m > they are cusp 
forms. 



c a (oo) 



= a 




(' 



-1 



(3) 
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7er a \r 

. i£, a (*,I)= 2 
7er a \r 

7er a \r 



e(?7icr a 72) 



z / J^aS^)' 

Jz ) j(v a 1 l,z) k 



Further, there are relations between these modular forms coming from the 
fact that the integral of I over the path {20,720} can be expressed, using Propo- 
sition [KT\ as a sum of products of integrals over {20,2}, {2,72} and {72,720}, 
where {zq, Zi} denotes a path from zq to Z\ in f). 

z iz 




Proof. We first show that the summand is well defined. For P 1 there is no 
question. The arguments for P 2 and P 3 are similar and we have the following 
argument which we give for P . 

It suffices to show that the term I is well defined on T a \r. Let a £ T a 
and 7 £ r. Since / is in H°(B S (X), xq) and a £ T a , from Lemma [321 we have 

1 = 



In particular, if z = 72:0 we have 



■yz 



1 = 



Hence the summand J J 1 is well defined on F a \F. 
We now have a lemma regarding convergence. 

Lemma 4.2. The series P l (z,I) converge for k > 2. 

Proof. For i = 1, the series P 1 is simply a product of the classical Poincare 
series and f z I, both of which converge for k > 2. 
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For P 3 (z, /) the argument is similar to the case oi I = f in UDO06. We can 
assume / is in H°(B s (X),Xo) since an element of H°(B s (X),Xq) differs from 
such an / by a constant, and in the twisted Poincare series this amounts to 
adding a constant multiple of a classical Poincare series. 

We use the estimate [DKMO06 , Lemma 3 - for a classical cusp form / of 
weight 2, any cusp a, 

f(w)dw < | log(/m(cr a z))| + 1. 

To simplify exposition, we use the notation y a (z) for Im(a a (z)). Using the 
above estimate repeatedly, we have that for an iterated integral / of length r, 

I <<; \log r (y a (z))\ | |log r - 1 (y a (z))| | l 
rl (r-l)\ 

Observe that 

uog^M + \M^m ... +1< exp{l logM , ))D < ya[z) + 

r! (r — 1)1 

(5) 

as exp{\ log(a;)|) — x or x' 1 . Replacing y a (z) by y a (z) e , we have, for < e < 1, 
using that e r < e, 

^ I^e- r y a (zy + yaL (z)-c) (6) 



I z 

To apply this to the convergence of the twisted Poincare series we need an 
estimate for J^ z I. We have 

r pzo pz 

' = £/ h n ( 7 ) 

j=0 z z ° 

where Ij and Jj are iterated integrals of lengths j and r — j respectively. From 
([6]) and ([7]) we have 

I r i\ « e~ r (r + i)(y*(zY + y*(z)- e )(y*(izy + y^-yz)-') (8) 

J z 

So we have 

(y a (zY + y a {z)-'){y a { n zY + y a (7*)~ e ) 



p a 3 (z,/)« J2 
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We have y a (jz) = jf^s- Replacing z) k by ( j$?f ) ^ in the expression 
above we get, 

p^i)«vM^[ E y»(^) k/2+e + E y»(^) k/2 - e ) + 
+y*( Z )- e - k/2 ( E y^) k/2+ '+ E ya( 7 ^) fe/2 - 

\7er c ,\r 7er a \r 
The sum 

e*(z,s)= E y^ z Y 

7er a \r 

is the classical non-holomorphic Eisenstein series for the cusp a and is known 
to be absolutely convergent in the region Re(s) > 1. So as long as fc/2 — e > 1, 
that is, k > 2, our series will converge. 

Using the change of basepoint formula, P 2 {z 1 T) can be expressed as a fi- 
nite linear combination terms of the form P 1 (z, I')P 3 (z, I") for some iterated 
integrals I' and I" , so converges in the same region. 

□ 

It remains to show the invariance property. 

Lemma 4.3. The P t (z, I) are higher order modular forms of weight k and order 
s + l. 

Proof. For P 1 this is immediate from the earlier proposition, as f* I is a weight 
order s + l form, while P(z) is order 1, weight k, so the product is order 
s + l, weight k. For the second one, let P(z,I) = (z,I). We will show 
that P(z, -OI/3-i can be expressed as a linear combination of terms of the form 
P(z,I r ) where /' is an iterated integral which is a homotopy functional, but of 
length strictly less than that of /. The theorem will then follow by induction. 
We have 

P((3z,I)j((3,z)- k -P(z,I) 
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e(mer a 72) 
/ 5(^7, *)* 7G p a \ r 
We can once more apply Propostion l2.1l with a = {z a , jz } and /3 = {jzq, 7/3 _1 Zo}- 
Since {72:01 7/? _1 ^o} is nomotopic to {zo, /3 20} on T\Sj, and / is homotopy in- 
variant, we obtain: 

1- 1= 7 +E/ 7 w 7 2 ( 10 ) 

where /[ and are sums of iterated line integrals appearing in the proof of 
Theorem 13. II They are homotopy functionals by construction. 
Combining this with @ we have 



P(Pz,I)j(p,z) 



-k 



( rp-^o \ s-1 / .p^zo \ 



(11) 

This, by induction on s, is a higher order modular form of weight k and order 
s. Hence P(z, I) is a higher order modular form of weight k and order s + 1. 

The third type of Poincare series is a higher order modular form as the 
iterated integral can be expressed in terms of the first two and products of 
lower order integrals using the change of basepoint formula which comes out of 
Proposition 12. II and the fact that 

pz 

1= / I 



zq •J'yzo 

for 7 e r. 

To show that P m ,n{z, I) is cuspidal for m > using we have, by in- 
duction, that P m ,a.(z, I)\f3-i is cuspidal. Further, if is a parabolic element, 
P m ,aO*,-OU-i = as J?* 12 = as all the I\ lie in H°(B a (X,x )). In fact, 
this condition is also satisfied for m — when s > 0. 

□ 

This completes the proof that the twisted Poincare series give higher order 
modular forms. □ 
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For example, when I = /, where / is a weight 2 cusp form, either holo- 
morphic or anti-holomorphic, then P 2 (z,f) = — P 3 (z,/) as in this case the 
integrals do not depend on the base point. In general, however, these forms 
could be different, but they are related. 

In |JO06j certain higher order non holomorphic Eisenstein series are con- 
structed by twisting Eisenstein series by products of modular symbols. One can 
also twist non-holomorphic Eisenstein series by iterated integrals to get higher 
order non-holomorphic Eisenstein series. The ones constructed by Jorgenson 
and O 'Sullivan are then special cases of this construction because the product 
of modular symbols can be expressed as a sum of iterated integrals via the 
shuffle product of iterated integrals. 

4.1 Weight 2 

The case of weight 2 modular forms requires a little more delicate handling as 
the Poincare series do not converge. An approach to resolving this is to use 
the ideas of Diamantis and O'Sullivan [DO06 . They overcome this problem by 
defining it as a function obtained as a special value of the analytic continuation 
of a certain Poincare series with an additional factor which makes it converge. 
Precisely, for an integer m and a cusp a, define 

e(ma~ 1 jz)Im(a~ 1 "fz) s 

As a function of s this has an analytic continuation to the entire complex plane. 
In particular, one can put s = and the resulting function 

is weight 2, order s + 1 modular form. The argument is similar to that of 
Diamantis and Sim [DS06a . However, as the details are complicated, we will 
not deal with this case in the remaining part of this paper. 

4.2 Spaces of higher order and higher weight modular 
forms 

In the previous sections we constructed some examples of higher weight, higher 
order forms. We would like to define the space M s g ^ m k (T, xq) to be the largest 



•Zm.a^j S, /) 



E 
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space we can get from the constructions above. For that we first define a space 
of primitive forms. 

The space of primitive cusp forms SPMg^~ om k (T, xq) is defined to be the 
space spanned by the forms P m>& {z,I) and their complex conjugates over all 
cusps a and all positive integers to. The space of primitive modular forms 
PMgtom fc(r,£o) is then the space spanned by SPM^ om k and the Eisenstein 
series E a (z, I) = Po tSL (z, I) over all cusps a where / is in H°(B S (X), zq). As the 
space of smooth modular forms of order s and weight k is finite dimensional, 
this space is finite dimensional. In weight all the forms constructed above as 
anti-derivatives of iterated integrals are said to be primitive. 

There is a product structure on the space of modular forms of higher order. 
This was first introduced by O'Sullivan. If F is a modular form of weight k\ 
and order s\ and G is a modular form of weight hi and order S2, then from 
|CD06j . the Rankin-Cohen bracket for N — 0, we have that FG is a modular 
form of weight fci + k 2 and order s% + s 2 — 1. 

We can see this easily in the weight case - The product of two iterated 
integrals of orders Si and S2, which correspond to modular forms of order Sj + 1, 
is an iterated integral of order s\ + s 2 whose anti-derivative is an modular form 
of order s x + s 2 + 1 = (si + 1) + (s 2 + 1) - 1. 

So we finally define the space of geometric higher order modular forms 
of order s and weight k, M s geom fc (r, xo) to be the algebra generated by the 
primitive forms and similarly the space of geometric higher order cusp forms 
SMgeom fc(r> ^0) to be the subalgebra generated by the primitive cusp forms. A 
weight k form, therefore, is a sum of products of lower weight primitive forms. 
To study this space in more detail we have to include the space of weight 2 
higher order forms which, as mentioned above, requires more delicate handling, 
so in what follows we will only consider the primitive spaces. 

4.3 Hodge Structures 

We can define an ad hoc Hodge structure on the spaces of primitive modular 
forms, PMg eom k . The weight and Hodge filtration are defined as follows. Recall 
that on H°(B s (X),x ), the (Hodge) weight filtration and filtration by length 
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coincide. Define 

• WiPM s +^ n k = Span of {P m ^ k (z, I), P m .^ k {z, I) and E a , k (z, if )} such 
that I G I4V(fc-i)ff°0Bs(^),2:o),m > and X G ^_ fe i/ (B s (X), a*) 
and where all the Poincare and Eisenstein series are of weight k. 

• F p PM geom . k s+i = Span of {P m ,a,k(z, I), P m ,a,k{z, J) and E^ k (z, if )} such 
that m > 0, I e F p -^-^H°{B s {X),x {) ), J G F P H°{B S (X), x ) and 
K e FP-( k / 2 )H G {B s (X),x ). 

So, for example, if k — 4, s = 2, the weight filtration on PM 3 eomA is as follows 

• W - VKi = VK 2 = 0. 

• Ws = Span of P m ,&{z) and P m , a (z) = holomorphic and anti-holomorphic 
cusp forms of weight 4. 

• W4 = Span of Eisenstein series E a {z) of weight 4 and span of P m ^ a (z,I) 
and P mya (z,T), where I is in H°(Bi(X), z ). 

• W 5 — Span of Wi,P m ^(z, I), P m . a (z, I) where I is in H°(B 2 {X), x ) and 
E a (z,J) where J is in z ). 

• W 6 = PM z geomA = Wi,i > 6 = Span of W 5 and £ a (z, J) where J is in 
H°(B 2 (X),x . 

and the Hodge filtration is given as follows. 

. F° = PM3 eomA 

• F 1 = Span of P m . a (z,I), where 7 G F 1 H°{B 2 (X),x ), P m , a (z,J) where 
J G H°(B 2 (X),x ) and E a (z,K) where if G H°(B 2 (X), x ) 

• F 2 = Span of P m . a {z,I), where 7 G F 2 H°{B 2 {X) 1 x ),P m . a {z,J) where 
J G H (B 2 (X),x ) and E a (z,K) where if G H°(B 2 (X),x ). 

• F 3 = Span of P m , a (,z, J) where J G H°(B 2 (X), x ) and E a {z,K) where 

if ei^ii^pf),^). 

• F 4 = Span of P m , a (z, J) where J G F 1 H°{B 2 (X), x ) and E a (z,K) where 
if eF 2 ii (B 2 (X),a;o). 
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• F 5 = Span of P m ,*(z, J) where J e F 2 H°(B 2 (X),x ). 

• F, = i > 6. 



We expect that this Hodge structure can be used to define a Hodge structure 
on the full space of geometric higher order forms using the fact that it is the 
algebra generated by these forms, but since that requires the weight 2 case as 
well, we will not consider it here. 

At the moment it is not clear whether there is some natural geometric struc- 
ture underlying this Hodge structure, and so one cannot say anything about 
naturality or functoriality. However, there is some recent work of Anton Diet- 
mar |Die08| relating higher order forms with Lie algebra cohomology and one 
might hope that this Hodge structure is related to a natural Hodge structure 
on those cohomology groups. 
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